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1.  INTRODUCTION 


When  a  tropical  cyclone  or  a  tropical  depression  threatens 
the  western  North  Pacific  region,  the  Joint  Typhoon  Warning 
Center  (JTWC)  in  Guam  is  responsible  for  providing  tropical 
cyclone  forecasts  and  warnings  to  all  U.S.  concerns. 

At  present,  up  to  26  objective  tropical  cyclone  track  fore¬ 
cast  aids  are  available  to  JTWC  forecasters.  Although  these  aids 
appear  to  give  substantial  assistance,  they  usually  conflict  with 
one  another  (Figure  1)  and  seldom  provide  uniform  and  coherent 
guidance.  Using  the  current  synoptic  pattern,  it  is  the  duty 
forecaster's  responsibility  to  select  the  proper  objective  aid. 

In  deliberation,  forecasters  may  opt  for  aids  they  are  familiar 
with  and  forgo  other  aid(s)  that  may  be  more  suitable  for  the 
situation.  As  a  result  of  this  familiarity,  forecasters  may 
face  a  long  learning  period  before  accepting  these  other  "aids." 
To  shorten  the  learning  process,  periodic  reviews  must  be  made 
to  reveal  the  performance  characteristics  of  these  objective 
aids.  The  goals  of  this  study  are  to  examine  systematically  the 
operational  performance  characteristics  of  all  JTWC  objective 
forecast  aids,  and  to  explore  the  means  to  use  these  characteris¬ 
tic  statistics  for  forecast  adjustments. 

Past  studies  on  Atlantic  hurricanes  (Neumann  and  Pelissier, 
1981;  Neumann,  1981a, b)  suggested  that,  despite  the  advances  of 
computer  technology,  the  improvement  in  the  quality  of  satellite 
images  and  the  introduction  of  sophisticated  objective  techni¬ 
ques,  including  numerical  tropical  cyclone  models,  have  improved 
official  forecast  skills  only  slightly  since  1970.  As  shown  by 
Jarrell  et  al.  (1978)  and  Figure  2,  a  similar  predicament  applies 
to  the  JTWC's  skill  in  forecasting  the  western  North  Pacific 
tropical  cyclones.  To  rectify  the  situation,  many  new  aids  for 
improving  forecast  guidance  were  introduced.  This  introduction 
of  new  aids,  however,  may  not  be  the  most  efficient  way  to 
improve  forecasts;  it  may  even  be  counterproductive  because 
more  aids  simply  cause  greater  confusion  (Neumann  and  Pelissier, 
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Figure  1. 


The  Standard  Array  of  JTWC's  Objective  Forecast  Aids  to  Support  the 
83081912  Warning  for  Tropical  Storm  Dorn. 
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1981),  as  shown  in  Figure  1.  As  in  a  tropical  cyclone  warning 
situation,  where  time  is  limited,  choosing  from  26  different 
objective  aids  could  be  a  formidable  task  for  the  forecaster. 

To  assist  forecasters  in  understanding  more  about  these 
aids,  so  that  some  logical  selection  procedure  may  be  realized, 
Tsui  (1984)  inter-compared  the  OTWC  official  and  objective  aid 
forecasts.  He  found  that  the  Nested  Tropical  Cyclone  Model 
(NTCM),  although  lacking  speed,  provided  good  guidance  in  the 
heading  of  the  storm.  He  also  found  that  blending  of  Half 
Persistence  and  Half  Climatology  (HPAC)  gave  amazingly  good  72-hr 
forecast  guidance.  Elsberry  and  Peak  (1986)  used  the  cross-track 
and  along-track  concept  to  evaluate  the  aids  and  ranked  the  One¬ 
way  Interactive  Tropical  Cyclone  Model  (OTCM)  as  the  top  aid  for 
the  1979-83  period  because  it  provided  an  excellent  directional 
change  forecast.  They  found,  however,  that  when  OTCM  errs  it 
would  most  likely  be  in  the  degree  of  directional  change,  not 
in  the  sign  of  the  directional  change.  Also,  Elsberry  and  Peak 
discovered  that  the  HPAC  technique  possesses  some  measurable 
skills. 

Tsui  (1984)  demonstrated  that  if  the  "correct"  guidance  is 
chosen  consistently,  the  24-,  48-,  and  72-hr  forecasts  would 
improve  by  47%,  53%,  and  56%,  respectively.  "Correct"  means 
that  the  forecast  track  of  an  objective  aid  produces  the  least 
forecast  errors.  The  forecast  error  is  defined  as  the  shortest 
distance  between  the  verified  and  the  forecast  positions.  Since 
some  of  the  errors  refer  to  the  randomness  of  the  tropical 
cyclone  motion,  the  56%  error  reduction  for  a  72-hr  forecast 
can  never  be  realized.  This  does  not  detract  from  the  fact 
that  there  is  still  room  for  improvement  among  existing  aids, 
however.  Of  course,  the  level  of  improvement  depends  on  how 
well  we  know  when  and  how  to  follow  an  aid's  guidance. 

Peak  and  Elsberry  (1985)  used  a  "decision-tree"  approach  to 
find  the  best  forecast  guidance  among  three  analog  techniques. 
They  showed  that  a  "decision-tree"  analysis  can  help  the  fore¬ 
casters  to  select  the  "correct"  objective  guidance.  Elsberry 


and  Peak  (1986)  also  showed  that  by  knowing  the  biases  of  the 
aids  with  respect  to  the  C 1 i m atol ogy- Pers i stence  (CLIPER) 
technique,  a  corrective  scheme  can  be  developed  to  improve 
JTWC's  forecasts.  It  has  become  increasingly  clear  that  the 
key  to  improve  tropical  cyclone  forecasts  in  the  near  future 
is  to  improve  the  utilization  of  the  aids,  not  necessarily  to 
improve  the  objective  aids  themselves. 

This  report  summarizes  the  results  of  a  comprehensive  review 
about  the  performance  of  all  JTWC  operational  objective  tropical 
cyclone  forecast  aids  during  the  eight  year  period,  1978-1985. 
Also,  it  will  identify  the  characteristics  of  the  operational 
performances  of  these  aids  and  attempt  to  suggest  methods  to 
improve  the  utilization  of  objective  aids. 

2.  JTWC  TROPICAL  CYCLONE  OBJECTIVE  FORECAST  AIDS 

As  discussed  by  Neumann  (1985),  objective  tropical  cyclone 
prediction  aids  can  be  classified  as  a  numerical  model  type  or 
a  statistical  type.  Within  these  two  types,  there  are  six 
subdivisions  of  models.  A  complete  description  of  all  26 
tropical  cyclone  objective  forecast  aids  available  to  the  JTWC 
forecasters  is  beyond  the  scope  of  this  report.  According  to 
Neumann's  classification,  however,  a  brief  introduction  of  these 
aids  is  warranted  to  provide  a  background  for  the  following 
discussions.  A  summary  list  of  the  Neumann  classification  of 
JTWC  objective  aids  is  given  in  Table  1. 

2 . 1  Analog  Method. 

The  analog  program  is  a  cl  i m atol ogi cal /st at i sti cal  forecast 
model.  The  skill  of  this  model  relies  on  the  premise  that  there 
are  families  of  tropical  cyclone  tracks  associated  with  repeti¬ 
tive  and  recognizable  large-scale  weather  patterns  (Neumann, 
1985).  This  premise  is  supported  by  the  fact  that  much  of  the 
variance  of  tropical  cyclone  motion  is  explained  by  seasonal 
variations.  The  analog  model  accepts  current  tropical  cyclone 
positions,  past  movements,  and  other  storm  characteristics,  and 


Table  1.  JTWC  tropical  cyclone  objective  aids  summary . 


1.  Analog  Method: 

RECR ,  STRA,  TOTL 

2.  Climatology-Persistence  Method: 

CLIM,  XTRP ,  HP  AC  ,  CLIP 

3.  Synoptic-Statistical  Method: 

C Y  20  ,  C Y  30  ,  C Y  50  ,  CY70,  CY85,  CY10 

4.  Dynamic-Statistical  Method: 

C Y  20  ,  C  Y  3  0  ,  C Y  50  ,  CY70,  CY85,  CY10,  CSUM,  COSM 

5.  Barotropic  Model:  (None) 

6.  Baroclinic  Model: 

OTCM ,  NTCM 

compares  these  parameters  to  those  of  the  past  tropical  cyclones 
within  the  same  geographic  area  (3  x  3  degree  area)  and  within 
the  same  month.  All  storms  with  a  certain  amount  of  similarity 
to  the  current  storm  are  weighted  and  summed  to  provide  a  24-hr 
forecast  position.  The  procedure  is  repeated  (Jarrell  and 
Wagoner,  1973)  to  obtain  the  48-  and  72-hr  forecasts. 

Depending  on  the  data  base,  the  analog  technique  produces 
three  separate  forecasts.  The  prediction  based  on  the  tracks  of 
those  historical  recurving  storms  is  called  the  "RECR"  forecast. 
A  recurving  storm  is  defined  as  a  storm  that  turns  toward  the 
north  or  northeast  from  an  initial  westward  direction.  The 
prediction  based  on  the  tracks  of  those  historical  straight 
moving  (predominately  westward  moving)  storms  is  called  the 
"STRA"  forecast.  The  prediction  based  on  the  entire  data  base 
is  called  the  "TOTL"  forecast. 

2 . 2  Climatology/Persistence  Method  . 

Despite  the  simplicity,  the  climatology  combined  with  the 
persistence  method  has  a  surprisingly  measurable  forecast  skill 
The  simplest  program  is  the  climatology  program  (CLIM).  CLIM 
24-hr  forecast  is  generated  by  computing  the  average  24-hr 


displacement  of  the  past  storms.  These  past  storms  are  located 
within  a  3  x  3  degree  area  of  the  current  storm  and  within  the 
same  montn.  To  obtain  the  48-  and  72-hr  CLIM  forecasts,  the 
procedure  is  repeated.  The  climatology  data  base  is  the  same 
data  base  used  by  the  analog  objective  aid  TOTL.  Through  years 
of  experience  in  using  CLIM  as  a  guidance,  JTWC  forecasters 
discovered  that  a  tropical  cyclone's  movement  is  influenced 
consistently  by  the  motion  of  the  storm  away  from  the  climatology 
track.  Hence,  the  simple  "Half  Persistence  and  Climatology" 
(HPAC)  forecast  method  was  developed.  HPAC  forecast  is  simply 
the  average  of  the  CLIM  and  persistence  forecasts.  The  persist¬ 
ence  forecast  is  called  XTRP  for  "extrapolation"  and  is  produced 
by  extending  the  immediate  past  12-hr  storm  motion  for  24,  48, 
and  72  hours. 

To  capitalize  on  the  success  of  HPAC,  two  variations  of  HPAC 
have  been  developed.  TPAC  differs  from  HPAC  only  in  the  72-hr 
forecast  which  is  composed  of  three  parts  of  climatology  and  one 
part  of  persistence.  The  Blended  Persistence  and  Climatology 
( BP AC )  forecasts  are  different  from  HPAC  forecasts  in  that  the 
CLIM  forecasts  are  weighted  more  toward  the  72-hr  forecasts.  In 
addition,  direction  and  speed  of  the  storm  can  heavily  influence 
the  weights  between  CLIM  and  XTRP.  This  aid  was  developed  by 
JTWC  forecasters  who  intended  to  capitalize  on  the  success  of 
the  climatology/persistence  technique. 

Another  type  of  the  climatology/persistence  program  is  the 
CLIPER  regression  model.  A  cubic  polynomial  regression  equation 
for  the  western  North  Pacific  region  called  CLIP  was  developed  by 
Xu  and  Neumann  (1985).  CLIP  uses  eight  predictors  which  includes 
the  current  storm  motion,  location,  intensity,  and  past  storm 
motion. 

2 .  3  Statistical  Method  . 

The  statistical  programs  can  be  divided  into  two  types: 
Synoptic-Statistical  Programs  and  Dynamic-Statistical  Programs. 
Typically,  both  programs  are  regression  models  and  usually 
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include  persistence,  climatology,  and  atmospheric  forcing 
variables  as  predictors.  The  difference  between  the  two  is 
that  the  Sy no pt  i  c - St  a t  i  s t  i  c al  models  derive  the  atmospheric 
forcing  terms  from  synoptic  analysis  fields  and  Dynamic- 
Statistical  models  derive  their  forcing  terms  from  dynamic 
produced  forecast  fields.  JTWC  has  both  types. 

CYCLOPS,  developed  by  Renard  (1968,  1973),  uses  geostrophic 
winds  as  the  forcing  to  steer  storms.  The  geostrophic  wind  is 
derived  from  a  smoothed  geopotential  height  field.  When  a 
500  mb  height  field  is  used,  the  forecast  is  called  CY50.  In 
total,  seven  height  fields  (1000,  350,  700,  500,  400,  300,  and 
200  mb)  are  used  by  CYCLOPS.  In  addition,  two  versions  of  the 
CYCLOPS  are  available  to  JTWC  forecasters:  the  forecasts  made 
by  using  the  geostrophic  winds  derived  from  the  analysis  fields, 
and  those  derived  from  the  prognostic  fields.  Hence,  CYCLOPS  is 
both  a  synoptic-  and  dynam i c - s t a t  i  s t i ca 1  program  that  provides  a 
total  of  14  forecasts  to  JTWC  forecasters. 

CYCLOPS  forecasts  aids  are  the  least  satisfactory  in 
comparison  to  other  objective  aids;  however,  these  aids 
(especially  CY35,  CY70,  and  CY50)  are  routinely  used  by  the 
forecasters  as  tools  to  identify  the  synoptic  scale  features. 
Since  CYCLOPS  forecast  tracks  are  the  direct  reflections  of 
steering  currents,  experienced  forecasters  can  use  these  tracks 
for  measuring  the  vertical  wind  shear,  changes  in  steering  at 
various  level,  and  depth  of  weakness  of  the  sub-tropical  ridge. 
In  quantifying  these  synoptic  measures,  Allen  (1984)  developed  a 
model  output  statistics  technique  called  "C0SM."  C0SM  combines 
the  7 7 -hr  forecasts  of  CY85,  CY70,  and  CY50  through  regression 
equations  to  yield  the  C0SM  72-hr  forecast  position.  Then  the 
48-hr  and  24-hr  positions  are  derived  by  a  linear  combination  of 
persistence  and  straight  line  interpolation  between  the  current 
and  72-hr  position. 

Matsumoto  (1984)  developed  a  dynam i c- st at i st i cal  model 
called  " C S U M "  and  is  currently  available  to  JTWC  forecasters 
as  an  objective  forecast  aid.  The  methodology  of  CSUM  is  very 


similar  to  NHC73  (Neumann  and  Lawrence,  1975).  Instead  of 
developing  the  regression  equation  for  the  entire  basin,  CSUM 
develops  a  regression  equation  for  each  of  the  three  sub-basins. 
The  sub-basins,  in  relation  to  the  subtropical  ridge,  are 
delineated  according  to  the  storm's  position:  north  of  the 
ridge,  on  the  ridge,  and  south  of  the  ridge. 

2 . 4  Numerical  Models 

Neumann  (1985)  divided  the  numerical  models  into  barotropic 
models  and  baroclinic  models.  Among  the  JTWC  aids,  there  are  two 
baroclinic  models.  One-Way  Interactive  Tropical  Cyclone  Model 
(OTCM)  is  a  coarse  mesh,  three  layer  primitive  equation  model 
with  a  205  km  grid  spacing  over  a  6400  x  4700  km  domain  (Harrison 
and  Elsberry,  1972,  Ley  and  Elsberry,  1976,  Hodur  and  Burk, 

1978).  A  symmetric  tropical  cyclone  is  bogused  into  850  mb  wind 
fields.  The  tropical  cyclone's  vicinity  winds  are  smoothed.  The 
storm's  past  motion  is  somewhat  adjusted  to  the  initial  steering 
field.  The  boundary  wind  components  normal  to  the  boundary  is 
adjusted  so  that  no  net  divergence  exists  in  the  domain.  The 
one-way  interactive  boundary  condition  is  updated  every  12  hours 
by  the  prognostic  fields  of  the  Navy's  operational  global  weather 
prediction  model  (N0GAPS). 

Similarly  structured  to  that  of  the  OTCM  is  the  Nested 
Numerical  Tropical  Cyclone  Model  (NTCM).  The  NTCM  differs  by 
containing  a  finer-scale  mesh  which  is  nested  in  the  coarse 
grid  (Harrison,  1981,  Harrison  and  Fiorino,  1982,  Fiorino  and 
Harrison,  1982).  Early  versions  of  NTCM  are  initialized  by  the 
analysis  fields  and  runs  independent  of  the  large-scale  model 
prognostic  fields.  The  finer-scale  mesh  (41  km)  covers  a 
1200  x  1200  km  area  and  keeps  the  tropical  cyclone  at  its 
850  mb  center.  The  1984-85  version  runs  with  the  updated 
boundary  conditions  from  N0GAPS  and  the  area  coverage  is 
much  larger. 


3.  DEFINITIONS  AND  ERROR  MEASURES 


3 . 1  Definitions 

Before  the  error  measures  are  described,  definitions  of 
three  terms  used  in  this  study  should  be  explained.  These  are 
best  track  positions,  initialization  positions,  and  warning 
positions.  The  best  track  positions  are  synonymous  with  the 
verified  positions.  The  "best  track"  is  a  subjectively  smoothed 
storm  track  and  is  produced  in  the  post  storm  analysis  when  all 
available  information  is  present  and  screened.  The  other  two 
positions  are  produced  every  6  hours  (Warning  time).  Similar  to 
the  best  track  positions,  these  positions  are  also  determined 
subjectively.  The  positions,  however,  are  determined  by  using 
only  the  information  up  to  the  time  when  forecasters  are 
preparing  the  warnings. 

Since  all  objective  aids  are  located  at  the  Fleet  Numerical 
Oceanography  Center  (FNOC)  in  Monterey,  CA,  JTWC  forecasters  will 
usually  request  that  FNOC  provide  all  objective  aids  at  least  2 
hours  before  a  forecast  warning  is  prepared.  For  example,  a 
fore  caster  would  normally  prepare  the  12Z  warning  between  1 2 Z 
and  1 4 Z ,  and  issues  the  Tropical  Cyclone  Warning  at  or  before 
14Z.  This  current  12Z  storm  position  is  called  the  warning 
position.  When  forecasters  activate  the  objective  aids  at  10Z, 
they  are  initialized  with  the  06Z  storm  position;  these  aids 
produce  24-,  48-,  72-hr  forecasts  from  06Z.  This  06Z  storm 
position  is  called  the  initialization  position. 

Since  the  initialization  position  is  determined  in  the 
latter  part  of  a  warning  cycle,  when  new  storm  position  fixes 
are  available,  it  should  be  closer  to  the  best  track  position. 

As  indicated  above,  the  initialization  position  is  determined  4 
hours  after  06Z  and  the  warning  position  is  determined,  at  most, 

2  hours  after  12Z.  In  this  comparison  study,  the  JTWC  official 
12Z  forecast  is  compared  with  the  aid's  forecast  initialized  at 
12Z.  Hence,  the  objective  aids  have  a  2  hour  advantage  over  the 
JTWC  forecasters  in  getting  the  most  recer.t  information.  On  the 
other  hand,  forecasters  have  the  advantage  of  referring  to  the 


objective  aids  while  making  their  forecasts.  The  practice  of 
using  time  variations  for  comparing  official  forecasts  to  the 
objective  aid  forecasts  is  recognized  as  "fair"  and  "acceptable." 

Before  1983,  JTWC  forecasters  issued  the  warnings  on  or 
before  00Z,  06Z,  12Z,  and  18Z,  so  the  time  discrepancy  increases 
to  about  4  hours. 

3 . 2  Error  Measures 

The  most  frequently  used  tropical  cyclone  forecast  verifica¬ 
tion  measure  is  forecast  error  (FTE),  which  is  defined  simply  as 
the  shortest  distance  between  the  forecast  and  verified  positions 
(Figure  3a).  As  discussed  by  Neumann  and  Pelissier  (1981),  FTE 
is  not  an  absolute  objective  error  measure  because  the  verified 
position  is  extracted  from  the  best  track.  Since  no  other 
overall  error  measure  is  as  flexible,  however,  FTE  still  remains 
the  most  popular  forecast  verification  measure. 

To  supplement  FTE  in  investigating  the  characteristics  of 
the  objective  aids'  performance,  two  other  error  measures  are 
used  in  this  study:  cross-track  error  (XTE),  and  along-track 
error  (ATE).  Shapiro  and  Neumann  (1984)  have  shown  that  these 
two  error  components  together  are  better  than  the  popular  FTE  for 
error  measure.  XTE  and  ATE  are  two  components  of  FTE  (Figure  3a) 
decomposed  in  a  natural  coordinate  system.  The  coordinates' 
origin  is  placed  on  the  verified  position,  and  the  instantaneous 
motion  vector  is  the  motion  vector  of  the  best  track.  XTE 
indicates  how  accurate  the  forecast  track  is  with  respect  to 
the  best  track.  Positive  XTE  and  ATE  of  a  forecast  means  the 
forecast  is  off  to  the  right  and  ahead  of  the  corresponding  best 
track  position. 

Three  additional  common  error  measures,  computed  for  compar¬ 
ison  purposes,  are  tabulated  in  the  appendix.  These  errors  are 
track  error  (TKE),  speed  error  (SPE),  and  timing  error  (TME). 

TKE  is  the  shortest  distance  to  the  track  and  is  usually 
perpendicular  to  the  best  track  (Figure  3b).  When  forecast 
positions  reach  beyond  the  end  of  the  best  track,  the  TKE 
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Figure  3.  (a)  Schematic  Diagram  for  Forecast  Error  (FTE),  Cross-Track  Error 

(XTE),  and  Along-Track  Error  (ATE).  (The  instantaneous  motion 
vector  of  the  natural  coordinate  system  is  the  motion  vector  of 
the  best  track  of  the  immediate  past  hour.) 

(b)  Schematic  Diagram  for  Track  Error  (TKE),  Speed  Error  (SPE),  and 
Timing  Error  (TME).  (SPE  is  defined  as  the  difference  between 
the  forecast  path  (Path  F)  and  the  best  track  (Path  B)  divided 
by  the  forecast  period. 


becomes  the  shortest  distance  between  the  forecast  position  and 
the  last  verified  position.  For  the  sake  of  simplicity,  the 
track  error  is  computed  in  this  study  by  measuring  the  shortest 
distance  between  the  forecast  position  and  the  hourly  best  track 
position.  The  hourly  best  track  positions  are  estimated  through 
the  interpolation  scheme  devised  by  Akima  (1970).  Positive  TKE 
indicates  the  forecast  position  is  to  the  right  of  the  best 
track.  Unlike  XTE,  TKE  is  not  an  independent  error  measure. 

It  depends  on  the  forecast  speed  -  the  slower  the  movement,  the 
smaller  the  TKE.  Hence,  TKE  and  the  speed  of  the  storm  must  be 
evaluated  together. 

As  shown  in  Figure  3b,  SPE  is  the  speed  difference  between 
the  storm  traveling  along  the  best  track  (Path  B)  and  that  of 
the  forecast  track  (Path  F).  Path  B  begins  at  the  best  track 
position  while  Path  F  starts  at  the  initialization  position.  A 
positive  SPE  indicates  the  forecast  storm  speed  is  faster  than 
what  is  verified.  In  addition  to  TKE  and  SPE,  TME  evaluates  the 
timeliness  of  the  forecast.  It  is  the  time  difference  between 
the  verified  time  and  the  forecast  time  projected  by  the  TKE 
(F i  gure  3b). 

All  errors  are  compiled  in  terms  of  mean,  standard  devia¬ 
tion,  and  median.  The  median  is  estimated  through  a  gamma 
probability  distribution.  The  gamma  distribution's  shape 
and  size  parameters  are  estimated  by  the  data  sample  through 
the  Maximum  Likelihood  Function.  With  large  sample  sizes,  the 
estimated  gamma  median  approaches  the  true  median. 

3.3  F  Test 

The  analysis  of  variance  (F  Test)  used  in  this  study  detects 
whether  a  particular  forecast  aid  is  significantly  different  than 
other  aids.  For  example,  if  an  aid  producing  the  smallest  fore¬ 
cast  error  has  a  mean  FTE  value  that  is  significantly  different 
(95%)  from  that  of  the  next  aid,  do  the  following.  First,  all 
techniques  in  the  comparison  are  ranked  by  their  mean  FTE  values. 
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The  mean,  standard  deviation,  and  sample  size  are  considered  if 
an  F  Test  detects  that  a  technique  is  significantly  different 
from  others.  The  technique  with  the  largest  mean  FTE  is 
discarded  from  the  group.  The  F  Test  is  repeated  until  the 
techniques  are  similar  to  one  another.  If  there  is  only  one 
technique  left  in  the  last  group,  then  it  is  the  best  technique 
to  produce  the  smallest  mean  FTE;  however,  if  there  is  more  than 
one  aid  left  in  the  last  group,  the  difference  among  these  aids 
is  judged  as  not  statistically  significant  at  the  preset 
significance  level.  In  this  study,  all  F  tests  are  set  at  5% 
significance  level. 

4.  DATA 

Along  with  all  official  forecasts  and  best  track  informa¬ 
tion,  JTWC  has  retained  all  objective  aid  forecasts  used  in 
tropical  cyclone  warnings  since  1978.  These  data  records  are 
stored  on  the  computer  mass  storage  system  at  FNOC.  Each  record 
contains  the  six  hourly  storm  24-,  48-,  and  72-hr  forecast 
locations,  the  warning  position,  and  the  official  forecast 
positions  and  intensities  (central  surface  maximum  wind  speed). 
The  six  hourly  best  track  locations  and  intensities  are  stored 
in  a  separate  file. 

The  72-hr  XTRP  positions  in  this  study  are  computed  from 
the  XTRP  24-  and  48-hr  positions,  since  only  24-  and  48-hr  XTRP 
positions  are  saved  on  the  FNOC  record.  Hence,  the  72-hr  HPAC 
and  TPAC  positions  are  also  computed.  BPAC  will  not  be  examined 
in  this  study  because  the  BPAC  is  no  longer  an  active  objective 
aid  at  JTWC.  In  addition,  since  not  all  CYCLOPS  forecasts  are 
saved,  only  CY50  and  CY70  forecasts  are  studied  for  comparison 
purposes . 

Recent  aids  introduced  after  1984  will  not  be  examined 
because  of  the  small  sample  size.  COSM  and  CSUM  were  installed 
recently,  so  they  will  be  included  in  the  study  for  those  years 
when  data  are  available.  COSM  was  installed  before  1 9 8 4 ' s 


typhoon  season,  and  CSUM  was  installed  in  September  1985.  NTCM 
will  not  be  fully  examined  because  of  the  yearly  change  of  the 
model.  Several  drastic  changes  have  been  made  to  the  model  since 
1980,  and  the  characteristics  of  the  model  performance  of  one 
version  cannot  represent  that  of  the  other.  Tn  this  study,  only 
the  1985  version  of  the  NTCM  will  be  studied. 


5.  EVALUATION  OF  OFFICIAL  AND  OBJECTIVE  AID  FORECASTS  (1978-85) 

Since  the  requirement  for  Naval  evasion  operations  depends 
on  the  accuracy  of  the  long  range  forecast,  the  emphasis  of  this 
report  will  be  placed  on  the  72-hr  forecast  verification.  Unless 
otherwise  noted,  all  comparisons  of  and  references  to,  forecast 
errors  will  be  those  of  the  72-hr  forecast. 

5 . 1  JTWC  Performance 

As  mentioned  in  Section  1,  tropical  cyclone  forecast  skills 
have  improved  slightly  since  1970.  Figure  2  shows  that  this 
still  holds  true  for  JTWC.  However,  to  determine  if  JTWC 
possesses  skill  in  its  forecasts  or  has  improved  its  skill 
level,  the  variation  in  forecast  difficulty  from  year  to  year 
must  be  removed.  A  good  indicator  of  the  forecast  difficulty 
of  a  storm  is  the  climatology/persistence  model  CLIP  (Neumann 
1981b).  Figure  4  shows  the  difference  of  mean  FTE  between  CLIP 
band  JTWC  for  72-hr  forecasts.  Positive  values  indicate  that 
JTWC  is  better  than  CLIP  or  possesses  measures  that  are  consist¬ 
ent  throughout  the  years.  The  "bi-yearly  saw-tooth"  effect 
(Jarrell  et  al.,  1978)  still  appears  to  be  playing  a  role  in 
JTWC's  forecast  accuracy. 

5 • 2  Forecast  Aids  Comparison 

The  FTE  statistics  for  all  objective  aids  during  the  eight 
year  period  (1978-85)  are  shown  in  Table  2.  All  error  statistics 
compiled  yearly  are  found  in  the  appendix.  An  "F  Test"  shows 
that  the  top  5  techniques,  including  JTWC,  are  significantly 
better  than  the  others  but  not  different  from  one  another 
(F=1.3449,  Fc=2.3729).  Fc  is  the  critical  F  value  for  the  95% 


(201)  (264)  (192)  (185)  (351)  (143)  (250)  (173) 


Figure  4.  The  difference  of  72  hr  FTE  between  JTKC  and  the 
objective  aid  CLIP.  Positive  values  indicate  that  JTWC's 
performance  is  superior  to  CLIP'S  performance. 


Significance  Test.  It  was  good  to  find  that  JTWC,  compared  to 
any  other  objective  aid,  performed  very  well  for  the  24-hr  fore¬ 
cast.  Note  that  all  three  of  the  climatology/  persistence  models 
are  included  in  the  best  technique  group.  With  the  standard 
deviation  of  218  n  mi,  OTCM's  technique  is  more  consistent  than 
its  competitors  whose  standard  deviations  are  around  230  n  mi. 

Statistics  for  XTE  and  ATE  are  provided  in  Tables  3  and  4, 
respectively.  The  F  Test  indicates  that  the  HPAC  is  signifi¬ 
cantly  better  than  all  other  aids  (F=3.2705,  Fc=3.8448)  in 
terms  of  the  XTE,  while  OTCM  is  the  best  technique  (F=1.4062, 
Fc=3.S441)  when  considering  ATE.  Table  4  shows  the  slow  bias 
of  all  aids  and  the  official  OTWC  forecasts,  where  all  median 
values  are  negative.  The  results  are  consistent  to  the  findings 
of  Tsui  (1984).  Although  NTCM  was  considered  by  Tsui  as  the  best 
aid  for  the  heading  direction,  it  was  also  recognized  that  the 
extremely  slow  speed  bias  was  partially  responsible  for  NTCM's 
provision  of  good  heading  guidance.  OTCM  is  the  best  aid  for  the 
speed  forecast.  JTWC  clearly  recognizes  that  all  aids  are  slow 
(negative  ATE  median  values)  and  attempts  to  compensate  for  the 
slowness  in  the  official  forecasts. 

The  HPAC  technique  is  a  simple  average  of  the  CLIM  and  XTRP 
forecasts.  It  was  created  because  JTWC  forecasters  had  long 
suspected  that  the  verified  tropical  cyclone  track  usually  fell 
between  these  two  techniques  (Figure  5).  But  the  median  XTE  for 
HPAC  shows  a  forecast  bias  to  the  left  (median  =  -12.9  n  mi 
meaning  favoring  XTRP),  while  TPAC  is  to  the  right  (median  = 

14.1  n  mi  meaning  favoring  CLIM).  Therefore,  it  appears  that 
HPAC  could  be  improved  if  the  CLIM  forecast  was  weighted  more 
than  1/2  and  less  than  3/4.  A  sensitivity  test,  however,  made 
by  varying  the  weights  of  the  CLIM  and  XTRP  forecasts,  show  that 
the  current  1:1  ratio  gives  the  lowest  mean  FTE  for  the  entire 
eight  year  period.  Both  OTCM  and  JTWC  have  the  best  speed 
guidance;  but  OTCM  seems  to  produce  better  72-hr  speeds  and  JTWC 
is  excellent  in  estimating  the  24-hr  movement.  Although  RECR  has 
a  ooor  mean  ATE,  its  relatively  low  median  shows  that  at  times  it 
has  some  val ue. 


Table  3.  The  mean,  standard  deviation,  median,  and  sample  size  of  the  24-,  48- 
and  72-hr  cross  track  error  (XTE)  for  JTWC  official  and  objective  aid  fore¬ 
casts  during  the  1978-85  period.  (Units:  n  mi) 


o 

o 


Q 

UJ 


LO 

co 

cn 


O'! 

o 

00 

CT* 

CM 

x 

O 

o 

CM 

00 

co 

oo 

CM 

co 

i-^ 

00 

LO 

LO 

CM 

oo 

cr> 

o 

o 

co 

r—4 

LO 

x 

CT* 

CO 

cn 

CX> 

LO 

CM 

CO 

CO 

LO 

CO 

x 

o 

LO 

r— 1 

CM 

fH 

T~ H 

r—4 

CM 

CM 

CM 

i—4 

CM 

i—4 

1“ 4 

LO 

T— 4 

O 

x 

r— 4 

LO 

i — 4 

O 

CX 

CM 

CO 

CM 

CM 

CM 

LO 

<r> 

*—4 

cr> 

CO 

LO 

co 

o 

i—4 

t— 1 

LO 

rH 

x 

x 

o 

CM 

i—4 

<X* 

i—*4 

t—4 

CM 

co 

CO 

CM 

co 

i—4 

CO 

i—4 

CO 

CM 

CM 

co 

CM 

LO 

co 

CM 

LO 

CM 

CM 

CM 

t—4 

x 

i — 4 

t—4 

CO 

CM 

x 

iH 

CM 

LO 

00 

LO 

CX 

CM 

00 

<X 

LO 

C\J 

a* 

o 

i— 4 

O'* 

cx 

CM 

x 

LO 

c x 

LO 

LO 

CX 

x 

co 

CO 

CO 

CM 

co 

i—4 

co 

co 

CM 

co 

CM 

O'* 

00 

oo 

r— 4 

cx 

LO 

LO 

x 

cx 

CX 

LO 

O 

LO 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

CM 

CM 

o 

LO 

cx 

CM 

LO 

<x* 

O'! 

LO 

CX 

LO 

x 

t— 1 

CO 

* — 4 

t—4 

—4 

LO 

X 

LC 

IT*" 

*v“ 

1 

1 

» — 4 

1 

1 

1 

1—4 

ex* 

LO 

CX* 

X 

cr* 

x 

i—4 

LO 

CM 

LO 

x 

CO 

i— 4 

CM 

i— 1 

CM 

x 

»—4 

CM 

LO 

LO 

co 

r—4 

CM 

CM 

1 

CM 

LO 

CM 

1 

LO 

CM 

O 

i—4 

1 

1 

1 

1 

i 

1 

i — 4 

1 

LO 

00 

oo 

LO 

LO 

CM 

00 

x 

c r* 

O 

r—4 

r—4 

CM 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

CO 

LO 

CO 

00 

LO 

00 

o 

x 

00 

x 

CO 

cr i 

co 

CM 

i — 4 

r— 4 

1 

rH 

* — 4 

1 

CM 

t—4 

CM 

*3- 

i 

r—4 

1 

cx 

CX 

LO 

CO 

00 

CM 

o 

X 

X 

i—4 

00 

co 

00 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

x 

CM 

IX 

o 

00 

LO 

LO 

00 

X 

LO 

o 

CM 

CO 

CO 

cx 

x 

LO 

CO 

X 

co 

*3- 

co 

00 

o 

o 

o 

o 

co 

co 

i—4 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CO 

CO 

CO 

CO 

co 

CO 

LU 

1 — 

LO 

o 

X 

LO 

X 

t—4 

CO 

LO 

LO 

CX 

O'* 

r-4 

cr* 

X 

• 

• 

• 

• 

• 

• 

• 

■ 

• 

• 

♦ 

• 

» 

> 

CO 

a* 

co 

CM 

cx 

LO 

LO 

X 

cx 

LO 

CM 

X 

LO 

LU 

LO 

oo 

00 

LO 

X 

00 

cx 

cx 

CX 

o 

CM 

CO 

O 

i—4 

i—4 

rH 

i—4 

r-4 

i—4 

r—4 

t—4 

i—4 

r—4 

CM 

CM 

CM 

LO 

LO 

CM 

Oh 

LO 

r—4 

i—4 

X 

CO 

co 

LO 

LO 

CO 

CO 

• 

• 

• 

• 

• 

m 

• 

• 

• 

• 

• 

• 

• 

*3- 

X 

CM 

LO 

X 

LO 

oo 

oo 

cx 

o 

CM 

CM 

00 

cx 

co 

00 

X 

00 

O'* 

i—4 

CX 

CX 

o 

CM 

t—4 

i—4 

i—4 

r—4 

i—4 

co 

LO 

CM 

CM 

CM 

o 

CO 

cx 

co 

X 

cx 

LO 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

CM 

CM 

LO 

i—4 

co 

LO 

00 

cx 

o 

LO 

LO 

X 

CM 

IX 

o 

i—4 

CM 

CM 

CM 

CM 

CM 

LO 

LO 

00 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CX* 

00 

X 

<x 

X 

X 

a> 

o 

o 

O 

o 

i—4 

i—4 

CO 

CM 

i—4 

i—4 

CM 

CO 

cx 

o 

*3- 

X 

LO 

co 

co 

CO 

<c 

*x 

CO 

«x  *x 

CO 

CM 

CO 

LO 

LO 

LO 

LO 

X 

X 

X 

LU 

i—4 

i-H 

r—4 

i—4 

i—4 

1—4 

i— *4 

i—4 

r—4 

r—i 

z 

CO  CX  O 

co 

X 

LO 

LO 

CO 

CM 

Or 

cx 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

* 

CX 

i—4 

X 

cr* 

00 

00 

CO 

X 

LO 

X 

LO 

^X 

CM 

LO 

X 

LO 

LO 

LO 

LO 

X 

00 

X 

X 

co 

cr* 

CO 

ooa.oS2Z_JOa.a:<2:o 

<  3«<^OhNauaHLf) 
Q.  h-ICLOl-O^hUJh 
IT'-DOh—  OOh-OXQCOOOO 


19 


Verified  Position 
CUM  Forecast  Position 
XTRP  Forecast  Position 


5.3  Year-to-Year  Variabilit 


In  order  to  examine  the  consistency  of  a  technique's 
performance  from  year  to  year,  the  F  Test  is  used.  Table  5 
presents  the  best  techniques  of  each  year  (denoted  by  an  "x"). 

The  yearly  FTE's  are  compared  through  the  F  Test  for  a  given 
forecast  period  (TAU).  When  aids  are  considered  to  be  the  best 
techniques  of  the  year,  this  indicates  that  the  difference  of  the 
FTE  mean  values  among  these  techniques  are  not  statistically 
different  at  the  5%  significance  level.  The  bottom  of  Table  5 
shows  the  percentage  of  years  when  a  technique  was  considered  to 
be  the  best.  For  example,  six  out  of  eight  years  (75%),  OTCM  is 
a  top  technique  for  the  72-hr  forecast.  The  results  show  that 
JTWC,  OTCM,  and  the  three  climatology/  persistence  models  are  the 
most  consistent  and  reliable  forecast  techniques.  The  overall 
eight-year  performance  of  these  techniques  (see  Table  2)  was  not 
due  to  an  abnormally  "excellent"  year,  but  rather  a  consistent 
"good"  performance  every  year.  One  cannot  fail  to  note  that 
while  XTRP  and  CLIM  do  very  poorly  from  year  to  year,  their 
average  (HPAC)  does  amazingly  well  year  after  year. 

Since  COSM  was  developed  in  1983,  JTWC  has  only  seen  it  for 
two  years.  Though  the  long-term  performance  characteristics  of 
the  technique  cannot  be  determined  from  the  two-year  record, 

COSM  certainly  appears  to  be  a  reliable  forecast  technique. 

Table  6  presents  the  year-to-year  XTE  variation  which  repre¬ 
sents  the  accuracy  in  providing  the  storm  heading  direction 
guidance.  Unavoidably,  one  would  notice  that  HPAC  provides  the 
best  directional  guidance  in  72-hr  forecasting.  Combining  the 
consistency  of  HPAC,  TPAC,  and  the  median  values  shown  in  Table 
3,  one  can  suggest  that  the  storm  track  consistently  falls 
between  the  HPAC  and  TPAC  forecasts,  and  closer  to  HPAC  than 
TPAC. 

Table  7  shows  the  year-to-year  ATE  variation  of  the 
objective  aids  category.  OTCM  consistently  gives  the  best  speed 
guidance.  This  agrees  with  the  statistics  shown  in  Table  4. 


Table  5.  Year-to-year  comparison  of  FTE  among  JTWC  official 
and  all  objective  aids  (units  are  n  mi).  An  X  denotes  the 
aid  has  been  judged  one  of  the  best  aids  in  the  category. 
The  -  denotes  no  data  available  in  the  category.  Percents 
at  bottom  of  table  indicate  percentage  of  years  the  aid 
has  been  considered  to  be  the  best  aid. 
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Table  6.  Year-to-year  comparison  of  XTE  among  JTWC  official 
and  all  objective  aids  (units  are  n  mi).  An  X  denotes  the 
aid  has  been  judged  one  of  the  best  aids  in  the  category. 
The  -  denotes  no  data  available  in  the  category.  Percents 
at  bottom  of  table  indicate  percentage  of  years  the  aid 
has  been  considered  to  be  the  best  aid. 
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Table  7.  Year-to-year  comparison  of  ATE  among  JTWC  official 
and  all  objective  aids  (units  are  n  mi).  An  X  denotes  the 
aid  has  been  judged  one  of  the  best  aids  in  the  category. 
The  -  denotes  no  data  available  in  the  category.  Percents 
at  bottom  of  table  indicate  percentage  of  years  the  aid 
has  been  considered  to  be  the  best  aid. 
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From  Tables  3,  4,  6,  and  7,  we  conclude  that,  in  general,  the 
climatology/persistence  aids  give  good  directional  guidance, 
while  OTCM  gives  the  best  estimates  of  the  storm's  speed. 


Tables  6  and  7  show  that  JTWC's  speed  forecasts  are  markedly 
superior  to  its  track  forecasts.  There  are  several  reasons  for 
this  difference  in  skill.  The  forecasters  at  JTWC  already  know 
that  all  of  the  objective  aids  have  a  slow  storm  speed  bias. 

Thus,  by  simply  increasing  the  storm  speed  of  their  forecasts 
they  consistently  beat  the  objective  aids.  The  track  forecast 
biases  of  the  objective  aids  are  not  as  well  known  and  thus, 
no  systematic  correction  can  be  made  for  them  by  JTWC. 

In  addition,  JTWC  faces  the  constraint  to  maintain 
continuity  between  forecasts.  This  can  result  in  large  track 
errors  for  several  successive  forecasts.  An  example  of  this  is 
seen  when  the  storm  makes  a  rapid  and  unexpected  change  in  its 
direction.  In  such  a  situation,  the  JTWC  directional  forecasts 
will  lag  behind  the  change  for  the  next  12-24  hours  in  order  to 
maintain  continuity.  The  objective  aids,  however,  have  no  such 
constraints  and  thus,  can  change  their  direction  forecasts  to 
give  a  more  realistic  storm  track  prediction. 

5 . 4  Homogeneous  Comparison 

To  compare  the  utility  of  the  objective  forecast  aids  of 
each  technique  type  as  shown  in  Table  1,  we  have  selected  one 
aid  from  each  technique  type  to  form  a  homogeneous  data  base  for 
head-to-head  comparison.  The  aids  selected  for  comparison  are 
the  dynamic  model  (OTCM),  analog  model  (RECR)  and  climatology/ 
persistence  model  (HPAC),  along  with  JTWC  to  form  the  homogeneous 
data  base.  Synoptic/Dynamic-Statistical  model  is  not  selected 
for  the  head-to-head  comparison  because  of  the  small  sample  size 
of  COSM  and  CSUM  techniques  and  also,  the  poor  performance  of 
the  CYxx  type  aids.  For  all  eight  years  combined,  OTCM,  JTWC, 
and  HPAC  are  better  than  RECR,  but  not  significantly  different 
from  one  another  (F=1.5488,  Fc=19.4954).  Figure  6  shows  the 
yearly  mean  for  the  24-  and  72-hr  forecasts.  All  techniques 
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Figure  6.  Homogeneous  head-to-head  comparison  of  24  hr  and 
72  hr  FTE  among  JTWC,  OTCM,  HPAC  and  RECR,  1979-85.  The 
sample  sizes  are  in  parentheses. 


are  equal  in  short  range  forecasting.  For  72-hour  forecasts 
since  1980,  either  OTCM  or  HPAC  have  always  been  the  best  tech¬ 
nique.  Note  that  OTCM  does  not  show  the  sharp  year-to-year 
fluctuations  like  the  other  techniques.  As  expected,  the  RECR 
and  HPAC  are  both  depended  on  climatology;  their  year-to-year 
variations  are  similar,  except  RECR  is  worse  than  HPAC. 

In  a  homogeneous  head-to-head  comparison  of  OTCM  and  HPAC, 
HPAC  had  a  smaller  mean  FTE;  but  the  F  Test  shows  that  it  is  not 
significantly  better  than  OTCM  (F=12.9005,  Fc=254.2579).  This 
comparison  was  also  conducted  for  these  two  aids  and  JTWC.  In 
both  cases  the  objective  aid  had  a  lower  mean  than  JTWC,  but 
the  difference  was  not  significant  (OTCM  vs  JTWC,  F=4.5260, 
Fc=254.2561;  HPAC  vs  JTWC,  F=1.5909,  Fc=3.8441). 

Tsui  (1984)  points  out  that  if  the  best  objective  aid  for 
each  forecast  is  always  chosen,  a  56%  improvement  over  JTWC 
could  be  achieved.  A  similar  computation  using  only  OTCM 
and  HPAC,  shows  that  nearly  half  of  this  improvement  (27%)  is 
still  possible  even  though  only  two  aids  are  considered.  This 
indicates  that  if  we  can  just  understand  OTCM  and  HPAC  well 
enough  and  know  when  to  accept  or  reject  one  of  the  two  aids, 
we  can  have  a  substantial  improvement  for  72-hr  forecasts. 
Between  these  two  aids,  OTCM  was  selected  half  of  the  time  (48%), 
thus  demonstrating  the  fact  that  neither  technique  could  be 
solely  relied  upon.  Operationally,  the  JTWC  forecaster  still 
has  to  decide  which  technique  provides  the  best  forecast.  This 
decision,  however,  between  the  two  techniques  should  be  much 
simpler  than  selecting  one  of  26  forecast  aids.  For  example,  if 
a  storm  has  been  behaving  cl i m ato 1 ogi cal  1 y ,  it  is  likely  that  the 
HPAC  guidance  is  best.  When  the  synoptic  situation  is  abnormal 
or  the  storm's  movement  is  erratic,  then  OTCM  should  provide  the 
best  guidance.  A  scheme  to  extract  the  synoptic  pattern  (e.g., 
Elsberry  and  Peak  (1986))  should  be  able  to  assist  JTWC 
forecasters  in  determining  when  the  is  "normal"  synoptic 
situation.  From  that  determination,  a  decision  can  be  made 
to  follow  the  HPAC  or  OTCM  guidance. 
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6.  DATA  STRATIFICATIONS 


6 . 1  Recurving  Types  and  Intensities 

As  previously  discussed,  each  aid  has  its  strengths  and 
weaknesses.  So  far,  no  aid  outperforms  any  other  aid  in  all 
environmental  conditions.  For  example,  by  definition,  the 
XTRP  aid  cannot  provide  a  reliable  forecast  guidance  if  the 
storm  is  recurving.  For  the  same  reason,  we  suspect  that  since 
the  numerical  models  are  always  initialized  with  60-  to  105-kt 
intensities,  the  numerical  models  are  deficient  in  providing  good 
forecasts  for  tropical  storms.  In  order  to  detect  the  strengths 
and  weaknesses  of  the  aids,  the  objective  aids  are  compared  in 
different  types  of  situations.  Storms  are  classified  by  its 
track  and  intensity  characteristics  and  identified  as  a  straight 
mover,  a  recurver,  or  an  odd  mover.  If  a  storm's  track  is  not  a 
straight  mover  or  a  recurver,  it  is  an  odd  mover  that  could  be  a 
looper.  Also,  a  storm  can  be  classified  as  either  a  tropical 
storm  (35-63  kts),  a  typhoon  (64-129  kts),  or  a  super  typhoon 
(greater  than  129  kts). 

In  the  straight  moving  category.  Table  8  shows  that  the 
analog  methods  STRA  and  JTWC  are  by  far  the  best  forecast 
techniques  (F=2.4134,  Fc=3.8493).  Although  straight  storms 
are  among  the  easiest  to  forecast,  the  result  is  surprising 
because  the  persistence  model  XTRP  was  more  than  80  n  mi  worse 
than  STRA  (the  analog  method  gives  more  information  other  than 
extrapolation).  Straight  moving  storms  are  of  particular 
importance  because  a  large  percentage  of  them  make  landfall, 
while  many  recurving  and  odd  moving  storms  stay  well  out  to  sea 
during  their  lives.  JTWC  appears  to  predict  the  straight  moving 
storms  better  than  most  of  the  aids. 

The  best  five  techniques  (COSM,  RECR,  CLIP,  OTCM,  and  TPAC) 
at  forecasting  recurving  storms  (Table  9)  are  not  significantly 
different  (F=2.0090,  Fc=2.3744).  The  poor  performance  of  COSM 
in  the  straight  mover  category  (Table  8)  and  its  large  XTE  median 
(Table  3)  makes  one  suspect  that  COSM's  success  is  due  largely  to 


its  consistent  bias  to  recurve  all  storms.  Although  the  mean  FTE 
of  HPAC  is  lower  than  that  of  TPAC  overall  (Table  2),  TPAC  shows 
a  11.9  n  mi  improvement  over  HPAC  for  recurving  storms  in  Table 
9.  This  is  not  surprising  since  in  recurving  situations,  a  72-hr 
extrapolation  forecast  is  very  poor  and  HPAC  weighs  XTRP  twice  as 
much  as  TPAC  does  at  72-hrs. 

The  forecast  techniques'  performance  on  the  remaining 
odd  storms  in  the  data  base  is  very  similar  to  their  overall 
performance  (Table  2)  and  thus  is  not  presented  here.  The  fact 
that  STRA  and  RECR  perform  well  on  the  types  of  storms  they  were 
designed  for  shows  that  the  job  of  forecasting  a  tropical  cyclone 
is  largely  a  matter  of  determining  whether  or  not  a  storm  will 
recurve.  Once  this  is  known,  these  two  analog  models  can  provide 
good  guidance.  Almost  a  complete  reversal  of  positions  between 
Tables  8  and  9,  points  out  that  most  techniques  are  only  suitable 
for  either  straight  movers  or  recurvers.  The  fact  that  HPAC  and 
OTCM  are  not  the  best  but  the  second  best  guides  in  either 
category,  gives  strength  to  an  overall  evaluation  of  these 
models  (Table  2).  Of  course,  we  cannot  ignore  the  fact  that 
these  two  aids  are  the  best  aids  for  odd  moving  storms. 

Storms  are  also  classified  according  to  their  maximum 
intensity.  The  value  of  the  human  element  in  forecasting 
tropical  storms  is  reflected  in  the  statistics  (Table  10). 

This  table  shows  that  JTWC  easily  outperforms  the  numerical 
model  OTCM.  JTWC  forecasters  do  not  depend  solely  on  objective 
aids  for  guidance.  They  also  question  OTCM's  forecasts  of  a 
tropical  storm  for  the  following  reasons:  1)  OTCM  is  initialized 
with  a  bogus  typhoon  intensity;  2)  due  to  the  lack  of  a  well- 
defined  circulation  pattern,  the  storm's  position  fix  for  the 
model  may  not  be  as  accurate  as  desired. 

For  the  same  reasons,  objective  aids  that  usually  provide 
guidance  for  approximate  forecast  positions  should  do  well  in 
the  tropical  storm  category.  The  simple  analog  and  climatology/ 
persistence  models  give  better  guidance  than  the  dynamic  model 
(Table  10).  As  expected,  the  OTCM  shows  a  dramatic  improvement 


on  typhoons  (Table  11)  and  super  typhoons  (Table  12)  over  its 
tropical  storm  forecasts.  Statistics  were  computed  on  a  data 
base  that  contained  only  forecasts  that  were  made  for  a  tropical 
cyclone  of  at  least  typhoon  intensity.  OTCM's  mean  FTE  improved 
by  20  n  mi,  while  all  other  techniques  showed  only  a  1-5  n  mi 
improvement . 

Note  the  lower  mean  errors  for  super  typhoons  as  compared 
with  typhoons  or  tropical  storms.  This  is  because  intense  storms 
are  better  defined  and  less  erratic  in  their  movement  and  thus, 
"easier"  to  predict.  The  exception  to  this  is  COSM,  which 
performed  well  on  typhoons  but  showed  no  improvement  on  super 
typhoons.  COSM  uses  the  steering  flow  to  make  its  forecasts. 
Since  super  typhoons  achieve  such  strength  and  size  that  they 
modify  the  steering  current,  COSM's  poor  performance  in  compar¬ 
ison  to  the  other  aids  is  to  be  expected. 

For  the  computation  made  in  Section  5.4,  Table  13  shows  the 
number  of  times  OTCM  or  HPAC  was  the  best  technique  for  a  given 
storm's  intensity  and  track  character i sti cs.  As  expected,  HPAC 
is  better  than  OTCM  for  tropical  storms  and  straight  moving 
storms,  while  OTCM  performs  best  on  recurving  typhoons.  Even 
though  OTCM's  mean  FTE  is  much  lower  than  HPAC's  for  storms  of 
at  least  typhoon  intensity  (Tables  11  and  12),  HPAC's  FTE  was 
lower  more  often. 

6 . 2  Diurnal  and  Seasonal  Variations  . 

Using  the  homogeneous  data  base  for  JTWC,  OTCM,  HPAC,  and 
RECR  mentioned  in  Section  5.4,  the  data  were  screened  to  show 
variations  in  forecast  accuracy  due  to  hour  and  month 
di f f erences . 

To  understand  the  diurnal  variation  of  the  forecast  accuracy 
variation,  one  fact  should  be  kept  in  mind;  OTWC  and  objective 
aids  make  their  respective  forecasts  at  different  times  during 
the  six-hour  warning  cycle.  Intuitively,  the  HPAC  and  RECR 
should  have  no  diurnal  variation  since  they  depend  heavily  on 
climatology  and  make  no  distinction  between  day  or  night. 
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TABLE  13.  FREQUENCY  OF  OPTIMUM  TECHNIQUE  SELECTION  BETWEEN  OTCM 
AND  HPAC  BASED  ON  THE  TRACK  CHARACTERISTICS  AND  INTENSITY  DATA 
STRATIFICATION. 

The  tracks  are  classified  as  Straight  Moving,  Recurving,  and  Odd 
Moving.  The  intensities  are  classified  as  Tropical  Storm  (TS), 
Typhoon  (TY),  and  Super-Typhoon  (ST). 

OTCM/HPAC  Straight  Recurver  Odd  Total 

Tropical  Storm  17/34  8/2  12/16  37/52 

Typhoon  96/130  134/75  110/121  340/365 

Super  Typhoon  18/15  52/75  42/17  112/107 

All  Storms  131/179  194/191  164/154  489/524 

Figure  7,  however,  shows  that  the  hour  at  which  the  forecast 
is  made  has  an  effect  on  the  accuracy  of  the  forecast.  This 
variation  actually  does  not  reflect  the  performance  of  the 
method  but  the  accuracy  of  the  storm  position  fixes.  The  fixes 
of  00Z  and  06Z  are  usually  the  best  since  they  are  made  during 
daylight  hours.  Storm  fixes  made  for  18Z  are  better  than  12Z 
fixes,  since  the  first  daylight  fix  is  available  at  22Z  (0800L). 
The  forecaster  car  use  this  fix  to  adjust  the  error  prone  infra¬ 
red  satellite  fixes  made  at  night.  The  HPAC  and  RECR  variation 
in  Figure  7  reflect  this  reasoning.  Hence,  a  bad  or  erroneous 
fix  can  influence  the  forecast  accuracy  up  to  72  hours. 

For  a  number  of  reasons,  12Z  is  the  best  hour  for  JTWC. 

The  forecasts  made  at  06Z  by  the  objective  aids  are  good  because 
daytime  fixes  are  used,  which  improves  JTWC's  12Z  forecast.  The 
current  synoptic  analysis  fields  (00Z)  used  by  the  aids  are  only 
six  hours  old  vice  12.  Also,  since  12Z  is  just  after  sunset, 

JTWC  forecasters  have  the  entire  day  to  track  a  storm  and  thus, 
have  a  good  idea  of  its  direction  and  speed.  OTCM's  72-hr  FTE 
varies  little  from  hour  to  hour  and  thus  doesn't  appear  to  be 
affected  by  fix  accuracy. 

Figure  8  shows  the  variation  in  mean  FTE  from  month  to 
month.  HPAC  results  show  that  storms  occurring  in  the  most 
active  month  of  the  year  (September)  are  the  easiest  to  forecast. 
This  is  because  the  steering  mechanism  (the  subtropical  high) 
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Figure  7.  Diurnal  variation  of  the  72  hr  FTE  among  JTWC, 
OTCM,  HPAC  and  RECR,  1979-85.  Sample  sizes  in  parentheses 
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Figure  8.  Seasonal  variation  of  the  72  hr  FTE  among  JTWC, 
OTCM ,  HPAC  and  RECR ,  1  979-85  .  Sample  sizes  in  parentheses 


is  strongest  during  this  month.  The  accuracy  of  OTCM,  however, 
does  not  appear  to  depend  on  the  month.  Figure  8  also  shows 
that,  in  active  months,  JTWC  forecasters  should  weigh  HPAC  and 
OTCM  forecasts  more  heavily  than  they  have  in  the  past.  The  F 
Test  shows  these  two  objective  aids  to  be  significantly  better 
than  JTWC  in  September  (F  =  3.7605,  Fc  =  3.8724). 

6 . 3  New  Objective  Aids  in  1985 

As  previously  stated,  some  of  the  objective  aids  currently 
available  to  JTWC  were  not  discussed  because  of  their  small 
sample  size.  Their  1985  performance  along  with  JTWC  is  presented 
in  Table  14.  (Year  by  year  tables  for  all  techniques  and  error 
types  are  found  in  the  appendix).  Since  these  results  only  cover 
a  one  year  period,  the  NTCM  and  CSUM  overall  performance  cannot 
be  truly  determined.  The  two  techniques,  however,  have  the 
capability  of  being  the  best  forecast  aids. 

7.  SUMMARY 

This  study  was  performed  to  supply  the  Joint  Typhoon  Warning 
Center  (JTWC)  with  a  review  of  the  performance  characteristics  of 
objective  forecast  aids  currently  available  to  the  center. 

HPAC  had  the  lowest  mean  72-hr  FTE  for  the  eight  year  period 
1978-1985.  It  was  not  significantly  better  than  OTCM,  JTWC,  or 
the  other  two  climatology/persistence  models  in  providing  the 
best  track  forecast  or  directional  guidance,  however.  It  appears 
to  have  a  slight  bias  to  the  left  of  the  storm  path,  but  the 
sensitivity  test  shows  that  the  1:1  ratio  of  climatology  (CLIM) 
and  persistence  (XTRP)  produces  the  lowest  mean  FTE  in  comparison 
with  any  other  ratio  combination.  In  terms  of  the  speed  forecast 
or  the  ATE,  OTCM  is  the  best  aid.  But,  like  all  other  techni¬ 
ques,  OTCM  shows  a  tendency  to  under-forecast  storm  speed  (slow 
bias)  . 

The  analog  models  STRA  and  RECR  are  the  top  aids  on  straight 
and  recurving  storms,  respectively.  For  these  two  types  of 
storms,  HPAC  and  OTCM  showed  reverse  behavior;  HPAC  is  better  at 
straight  storm  forecasting,  while  OTCM  handles  recurvers  better. 


JTWC  appears  to  forecast  the  erratic  behavior  of  tropical 
storms  better  than  the  objective  aids  and  predicts  the  speed  of 
movement  rather  well.  Because  of  the  initialization  method  used 
in  OTCM,  this  model  is  not  dependable  for  forecasting  storms  with 
tropical  depression  or  tropical  storm  intensity. 

It  was  shown  that  the  accuracy  of  the  storm  fix  does  affect 
the  models  forecast  accuracy  (approximately  20  n  mi  difference 
at  72-hr  forecast  range).  In  addition,  JTWC  should  follow  the 
guidance  of  HPAC  and  OTCM  more  closely  in  the  active  months  than 
it  has  in  the  past. 

The  large  number  of  objective  aids  (26)  currently  available 
to  JTWC  is  adding  confusion  rather  than  assistance  to  the  job  of 
forecasting.  Tsui  (1984)  noted  that  "the  key  to  improve  tropical 
cyclone  forecasts  may  be  hinged  on  the  improvement  of  the  utili¬ 
zation  of  the  aids,  not  necessarily  on  the  improvement  of  the 
objective  aids."  This  study  has  shown  that  if  only  OTCM  and  HPAC 
were  considered,  the  forecasts  could  be  improved  by  27%  if  the 
best  forecast  was  always  chosen.  To  obtain  this  improvement,  the 
JTWC  forecaster  would  only  need  to  choose  between  two  techniques. 
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APPENDIX  A 


ANNUAL  FORECASTING  ERROR  STATIST  ICS 

This  appendix  includes  the  listings  of  annual  forecasting 
error  statistics  of  all  objective  aids  during  1978-85.  The 
computational  methodology  of  each  objective  aid  and  the  detailed 
definition  of  each  error  measure  are  given  in  Sections  2  and  3  of 
the  text. 

Objective  Aids 

BPAC:  Blended  Persistence  and  Climatology 
CLIM:  Climatology 

CLIP:  Climatology  and  Persistence  Model 

COSM:  CYCLOPS  Objective  Steering  Model  Output  Statistics 

CSUM:  Colorado  State  University  NHC-73  program 

CYxx:  CYCLOPS  steering  program.  xx  stands  for  the  level 
of  steering:  85  for  850mb,  70  for  700mb,  etc. 

HPAC:  Half  Persistence  and  Climatology 

JTWC:  Official  forecasts 

NTCM:  Nested  Tropical  Cyclone  Model 

OTCM:  One-way  Tropical  Cyclone  Model 

RECR:  Recurver  TYAN  analog  program 

STRA:  Straight  Moving  TYAN  analog  program 

TOTL:  TYAN  analog  program 

TPAC:  Quater  Persistence  and  Climatology 

XTRP:  Persistence  or  Extrapolation 

Error  Measures 

FTE:  The  Forecast  Error  is  the  shortest  distance  between 

the  forecast  and  verifying  positions.  Units:  n  mi. 

XTE:  The  Cross-Track  Error  is  one  of  the  two  components  of 

the  FTE  in  the  natural  coordinate  system.  XTE  is 
perpendicular  to  the  verified  track.  Positive  values 
indicate  that  the  forecast  positions  are  to  the  right 
of  the  verified  track.  Units:  n  mi. 


ATE:  The  Along-Track  Error  is  one  of  the  two  components 

of  the  FTE  in  the  natural  coordinate  system.  ATE 
is  parallel  to  the  verified  track.  Positive  values 
indicate  that  the  forecast  positions  are  ahead  of 
the  verified  positions.  Units:  n  mi. 

TKE:  The  Track  Error  is  the  shortest  distance  between  the 

forecast  position  and  veiified  track.  Positive  values 
indicate  that  the  forecast  positions  are  to  the  right 
of  the  verified  track.  Units:  n  mi. 

SPE:  The  Speed  Error  is  the  speed  difference  between  the 
forecast  and  verified  storm  movements.  Positive 
values  indicate  that  the  forecast  positions  are  ahead 
of  the  verified  positions.  Units:  kt. 

TME:  The  Timing  Error  is  the  time  difference  between  the 

verified  hour  and  the  forecast  hour  projected  by  the 
TKE.  Positive  values  indicate  that  the  forecast 
positions  are  ahead  of  the  verified  positions. 

Units:  hour . 


STDEV:  Standard  Delation. 
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COMMANDER  IN  CHIEF 
U.S.  ATLANTIC  FLEET 
ATTN:  FLT  METEOROLOGIST 
NORFOLK,  VA  23511-6001 


COMTHIRDFLT 

ATTN:  FLT  METEOROLOGIST 
FPO  SAN  FRANCISCO  96601-6001 


COMSEVENTHFLT 

ATTN:  NSAP  SCIENCE  ADVISOR 
BOX  167 

FPO  SEATTLE  98762 


COMMANDER 

U.S.  NAVAL  FORCES,  MARIANAS 
FPO  SAN  FRANCISCO  96630-0051 


COMNAVAIRPAC 

ATTN:  NSAP  SCIENCE  ADVISOR 

NAS,  NORTH  ISLAND 

SAN  DIEGO,  CA  92135-5100 


COMMANDER 

AMPHIBIOUS  GROUP  1 

ATTN:  METEOROLOGICAL  OFFICER 

FPO  SAN  FRANCISCO  96601-6006 


COMMANDING  OFFICER 
USS  KITTY  HAWK  (CV-63) 

ATTN:  MET.  OFFICER,  OA  DIV. 
FPO  SAN  FRANCISCO  96634-2770 


COMMANDING  OFFICER 
USS  CARL  VINSON  (CVN-70) 
ATTN:  MET.  OFFICER,  OA  DIV. 
FPO  SAN  FRANCISCO  96629-2840 


COMMANDER  IN  CHIEF 
U.S.  ATLANTIC  FLEET 
ATTN:  NSAP  SCIENCE  ADVISOR 
NORFOLK,  VA  23511-6001 


COMSEVENTHFLT 

ATTN:  FLT  METEOROLOGIST 

FPO  SAN  FRANCISCO  96601-6003 


COMMANDER 

U.S.  NAVAL  FORCES,  CARIBBEAN 
FPO  MIAMI  34051-8000 


COMMANDER 

U.S.  NAVAL  FORCES,  PHILIPPINES 
BOX  30/N3 

FPO  SAN  FRANCISCO  96651-0051 


COMNAVSURFLANT 

ATTN:  NSAP  SCIENCE  ADVISOR 

NORFOLK,  VA  23511 


COMMANDING  OFFICER 
USS  CONSTELLATION  (CV-64) 
ATTN:  MET.  OFFICER,  OA  DIV 
FPO  SAN  FRANCISCO  96635-2780 


COMMANDING  OFFICER 
USS  MIDWAY  (CV-41) 

ATTN:  MET.  OFFICER,  OA  DIV. 
FPO  SAN  FRANCISCO  96631-2710 


COMMANDING  OFFICER 
USS  NEW  JERSEY  (BB-62) 

ATTN:  MET.  OFFICER,  OA  DIV. 
FPO  SAN  FRANCISCO  96688-1110 


COMMANDER  IN  CHIEF 
U.S.  PACIFIC  FLEET 
CODE  02M 

PEARL  HARBOR,  HI  96860-7000 


COMTHIRDFLT 

ATTN:  NSAP  SCIENCE  ADVISOR 
PEARL  HARBOR,  HI  96860-7500 


COMMANDER 

U.S.  NAVAL  FORCES,  JAPAN 
FPO  SEATTLE  98762-0051 


COMMANDER 

U.S.  NAVAL  FORCES,  KOREA 
APO  SAN  FRANCISCO  96301-0023 


COMNAVSURFPAC 

(005/N6N) 

ATTN:  NSAP  SCIENCE  ADVISOR 
SAN  DIEGO,  CA  92155-5035 


COMMANDING  OFFICER 
USS  ENTERPRISE  (CVN-65) 

ATTN:  MET.  OFFICER,  OA  DIV. 
FPO  SAN  FRANCISCO  96636-2810 


COMMANDING  OFFICER 
USS  RANGER  (CV-61) 

ATTN:  MET.  OFFICER,  OA  DIV. 
FPO  SAN  FRANCISCO  96633-2750 


COMMANDING  OFFICER 
USS  BLUERIDGE  (LCC-19) 

ATTN:  MET.  OFFICER 

FPO  SAN  FRANCISCO  96628-3300 


COMMANDING  OFFICER 
USS  BELLEAU  WOOD  (LHA-3) 
ATTN:  METEOROLOGICAL  OFFICER 
FPO  SAN  FRANCISCO  96623-1610 


COMMANDING  OFFICER 
USS  PELELIU  (LHA-5) 

ATTN:  MET.  OFFICER 

FPO  SAN  FRANCISCO  96624-1620 


USCINCPAC 
BOX  28 

CAMP  SMITH,  HI  96861 


ASST.  FOR  ENV.  SCIENCES 
ASST.  SEC.  OF  THE  NAVY  (R&D) 
ROOM  5E731,  THE  PENTAGON 
WASHINGTON,  DC  20350 


OFFICE  OF  NAVAL  RESEARCH 
ENV.  SCI.  PROGRAM,  CODE  112 
ARLINGTON,  VA  22217-5000 


OFFICE  OF  NAVAL  RESEARCH 
CODE  1122  MM,  MARINE  METEO. 
ARLINGTON,  VA  22217-5000 


OFFICER  IN  CHARGE 
NAVOCEANCOMDET 
NAVAL  AIR  STATION 
BARBERS  PT.,  HI  96862-5750 


OFFICER  IN  CHARGE 

U.S.  NAVOCEANCOMDET 

FPO  SAN  FRANCISCO  96685-2905 


COMMANDING  OFFICER 

USS  NEW  ORLEANS  (LPH-11) 

ATTN:  MET.  OFFICER 

FPO  SAN  FRANCISCO  96627-1650 


COMMANDING  OFFICER 
USS  TARAWA  (LHA-1) 

ATTN:  MET.  OFFICER 

FPO  SAN  FRANCISCO  96622-1600 


USCINCPAC 
BOX  13 

STAFF  CINCPAC  J37 
CAMP  SMITH,  HI  96861 


CHIEF  OF  NAVAL  RESEARCH  (2) 
LIBRARY  SERVICES,  CODE  784 
BALLSTON  TOWER  #1 
800  QUINCY  ST. 

ARLINGTON,  VA  22217-5000 


OFFICE  OF  NAVAL  RESEARCH 
ATTN:  PROGRAM  MANAGER,  1122CS 
ARLINGTON,  VA  22217-5000 


CHIEF  OF  NAVAL  OPERATIONS 
(OP-952) 

U.S.  NAVAL  OBSERVATORY 
WASHINGTON,  DC  20390 


OFFICER  IN  CHARGE 

U.S.  NAVOCEANCOMDET 

APO  SAN  FRANCISCO  96519-5000 


OFFICER  IN  CHARGE 
U.S.  NAVOCEANCOMDET 
FLEET  ACTIVITIES 
FPO  SEATTLE  98770-0051 


COMMANDING  OFFICER 
USS  OKINAWA  ( L PH-3 ) 

ATTN:  MET.  OFFICER 

FPO  SAN  FRANCISCO  96625-1630 


COMMANDING  OFFICER 
USS  TRIPOLI  (LPH-10) 

ATTN:  METEOROLOGICAL  OFFICER 
FPO  SAN  FRANCISCO  96626-1645 


COMMANDER 

US  NAVAL  FORCES  CENTRAL  COM. 
PEARL  HARBOR,  HI  96860 


OFFICE  OF  NAVAL  RESEARCH 
CODE  1122AT,  ATMOS.  SCIENCES 
ARLINGTON,  VA  22217-5000 


OFFICE  OF  NAVAL  RESEARCH 
ATTN:  HEAD,  OCEAN  SCIENCES  DIV 
CODE  1122 

ARLINGTON,  VA  22217-5000 


OFFICER  IN  CHARGE 
NAVOCEANCOMDET 
FEDERAL  BLDG. 

ASHEVILLE,  NC  28801-2696 


OFFICER  IN  CHARGE 

NAVOCEANCOMDET 

NAVAL  AIR  STATION 

SAN  DIEGO,  CA  92145-5851 


OFFICER  IN  CHARGE 

NAVOCEANCOMDET 

NAVAL  AIR  STATION 

LONG  BEACH,  CA  90822-5072 


COMMANDING  OFFICER 

FLEET  INTELLIGENCE  CENTER 

(PACIFIC) 

PEARL  HARBOR,  HI  96860 


COMMANDING  OFFICER 
NAVAL  OCEANOGRAPHIC  OFFICE 
BAY  ST.  LOUIS 
NSTL,  MS  39522-5001 


COMMANDING  OFFICER 
U.S.  NAVOCEANCOMCEN 
BOX  12,  COMNAVMARIANAS 
FPO  SAN  FRANCISCO  96630-2926 


COMMANDING  OFFICER 
NAVOCEANCOMFAC 
NSTL,  MS  39529-5002 


CHAIRMAN 

OCEANOGRAPHY  DEPT. 
U.S.  NAVAL  ACADEMY 
ANNAPOLIS,  MD  21402 


LIBRARY 

NAVAL  POSTGRADUATE  SCHOOL 
MONTEREY,  CA  93943-5002 


COMMANDING  OFFICER 
WEATHER  SERVICE  OFFICE 
U.S.  MCAS  (HELICOPTER) 
FPO  SEATTLE  98-72 


COMMANDER 

NAVAL  OCEANOGRAPHY  COMMAND 
NSTL,  MS  39529-5000 


COMMANDING  OFFICER 
FLENUMOCEANCEN 
MONTEREY,  CA  93943-5005 


COMMANDING  OFFICER 
NAVOCEANCOMFAC 
NAS,  NORTH  ISLAND 
SAN  DIEGO,  CA  92135 


COMMANDING  OFFICER 
U.S.  NAVOCEANCOMFAC 
BOX  63,  NAS  (CUBI  PT) 

FPO  SAN  FRANCISCO  96654-2909 


DIRECTOR  OF  RESEARCH 
U.S.  NAVAL  ACADEMY 
ANNAPOLIS,  MD  21402 


COMMANDER 

NAVAIRSYSCOM,  CODE  526W 
WASHINGTON,  DC  20361-0001 


COMMANDING  OFFICER 
WEATHER  SERVICE  DIV. 

HQHQRON  OPERATIONS  (NEW  RIVER) 
MCAS  (HELICOPTER) 

JACKSONVILLE,  NC  28545 


COMNAVOCEANCOM 
ATTN:  CODE  N5 
NSTL,  MS  39529-5000 


COMMANDING  OFFICER 
NAVWESTOCEANCEN 
BOX  113 

PEARL  HARBOR,  HI  96860 


COMMANDING  OFFICER 
U.S.  NAVOCEANCOMFAC 
FPO  SEATTLE  98762-3500 


SUPERINTENDENT 
LIBRARY  REPORTS 
U.S.  NAVAL  ACADEMY 
ANNAPOLIS,  MD  21402 


NAVAL  POSTGRADUATE  SCHOOL 
METEOROLOGY  DEPT. 
MONTEREY,  CA  93943-5000 


COMSPAWARSYSCOM 
ATTN:  CAPT.  K.L.  VAN  SICKLE 
CODE  3213,  NAVY  DEPT. 
WASHINGTON,  DC  20363-5100 


USAFETAC/TS 
SCOTT  AFB,  IL  62225 


HQ  1ST  WEATHER  WING/DN 
HICKAM  AFB,  HI  96853 


nFT  3  lww/rr  dft  b  iww/cc 

APO  SAN  FRANCISCO  96334-5000  APO  SAN  FRANCISCO  96274 


OET.  8,  1WW/CC 

APO  SAN  FRANCISCO  96239 


OET  17,  1WW/CC 

APO  SAN  FRANCISCO  96328 


OET  18,  30  WS 

APO  SAN  FRANCISCO  96301 


DIRECTOR  (12) 

OEFENSE  TECH.  INFORMATION 
CENTER,  CAMERON  STATION 
ALEXANDRIA,  VA  22314 


DIRECTOR,  TECH.  INFORMATION 
DEFENSE  ADV.  RSCH  PROJECTS 
1400  WILSON  BL.VD. 

ARLINGTON,  VA  22209 


FEDERAL  COORD.  FOR  METEORO. 
SERVS.  &  SUP.  RSCH.  (OFCM) 
11426  ROCKVILLE  PIKE 
SUITE  300 

ROCKVILLE,  MD  20852 


DIRECTOR,  CENTRAL  PACIFIC 
HURRICANE  CENTER  NWS,  NOAA 
HONOLULU,  HI  96819 


UNIVERSITY  OF  HAWAII 
METEOROLOGY  DEPT. 
2525  CORREA  ROAD 
HONOLULU,  HI  96822 


ST  SYSTEMS  CORP  (STX) 

1900  GARDEN  RO.,  SUITE  130 
MONTEREY,  CA  93940 


DIRECTOR,  ENV.  &  LIFE  SCI. 
OFFICE  OF  UNDERSECRETARY  OF 
DEFENSE  FOR  RSCH  &  ENG  E&LS 
RM.  30129,  THE  PENTAGON 
WASHINGTON,  DC  20505 


ACQUISITIONS  SECT.  IRDB-D823 
LIBRARY  &  INFO.  SERV.,  NOAA 
6009  EXECUTIVE  BLVD. 
ROCKVILLE,  MD  20852 


DIRECTOR 

NATIONAL  HURRICANE  CENTER 
NOAA,  GABLES  ONE  TOWER 
1320  S.  DIXIE  HWY 
CORAL  GABLES,  FL  33146 


DIRECTOR 

FEDERAL  EMERGENCY  MANAGEMENT 
AGENCY  (FEMA) 

WASHINGTON,  DC  20472 


INSTITUTE  FOR  STORM  RESEARCH 
UNIV.  OF  ST.  THOMAS 
3600  MT.  VERNON 
HOUSTON,  TX  77006 


DIRECTOR,  JTWC 
BOX  17 

FPO  SAN  FRANCISCO  96630 


CENTRAL  INTELLIGENCE  AGENCY 
ATTN:  OCR  STANDARD  DIST. 
WASHINGTON,  DC  20505 


CHIEF 

MARINE  &  EARTH  SCI.  LIBRARY 
NOAA,  DEPT.  OF  COMMERCE 
ROCKVILLE,  MD  20852 


COLORADO  STATE  UNIVERSITY 
ATMOSPHERIC  SCIENCES  DEPT. 
ATTN:  DR.  WILLIAM  GRAY 
FORT  COLLINS,  CO  80523 


SCIENCE  APPLICATIONS 

INTERNATIONAL  CORP.  (SAIC) 
205  MONTEC ITO  AVE. 

MONTEREY,  CA  93940 


DIRECTOR,  ROYAL  OBSERVATORY 
NATHAN  ROAD,  KOWLOON 
HONG  KONG,  B.C.C. 


NATIONAL  CLIMATIC  CENTER 
ATTN:  L.  PRESTON  D542X2 
FEDERAL  BLDG.  -  LIBRARY 
ASHEVILLE,  NC  28801 


MARITIME  METEOROLOGY  DIV. 
JAPAN  METEOROLOGICAL  AGENCY 
OTE-MACHI  1-3-4  CHIYOOA-KU 
TOKYO,  JAPAN 


CENTRAL  WX  BUREAU 
64,  KUNG  YUAN  RD. 
TAIPEI,  TAIWAN  100 


DIRECTOR,  TYPHOON  MODERATION 
RSCH  &  DEVEL.  OFFICE,  PAGASA 
MINISTRY  OF  NATIONAL  DEFENSE 
1424  QUEZON  AVE. 

QUEZON  CITY,  PHILIPPINES 


COORDINATOR,  NATIONAL  ATMOS. 
RESEARCH  PROGRAM 
INSTITUTE  OF  PHYSICS 
ACADEMIA  SINICA 
TAIPEI,  TAIWAN 
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